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Abstract. We consider the inexact Newton methods 

for solving nonlinear ill-posed inverse problems Fix) = 1/ using the only avail- 
able noise data y s satisfying \\y s — y\\<5 with a given small noise level 6 > 0. 
We terminate the iteration by the discrepancy principle 

\\F(x s ne )-y s \\<T8<\\F(x s n )-y s l < n< n s 

with a given number r > 1. Under certain conditions on {a n } and F, we 
prove for a large class of spectral filter functions {g a } the convergence of a;* 
to a true solution as 8 — > 0. Moreover, we derive the order optimal rates of 
convergence when certain Holder source conditions hold. Numerical examples 
are given to test the theoretical results. 



1. Introduction 

In this paper we consider the nonlinear equations 
(1.1) F(x)=y, 

arising from nonlinear inverse problems, where F : D(F) C X 1— > Y is a nonlinear 
Frechet differentiable operator between two Hilbert spaces X and Y whose norms 
and inner products are denoted as || • || and (•, •) respectively. We assume that (1.1) 
has a solution x^ in the domain D(F) of F, i.e. F(x jf ) = y. We use F'(x) to 
denote the Frechet derivative of F at x € F>(F) and F'{x)* the adjoint of F'{x). 
A characteristic property of such problems is their ill-posedness in the sense that 
their solutions do not depend continuously on the data. Since the right hand side y 
is usually obtained by measurement, the only available data is a noise y s satisfying 

(i-2) \\y 5 -y\\<6 

with a given small noise level 5 > 0. Due to the ill-posedness, it is challenging 
to produce from y s a stable approximate solution to x^ and the regularization 
techniques must be taken into account. 

Many regularization methods have been considered for solving (1.1) in the last 
two decades. Tikhonov regularization is one of the well-known methods that have 
been studied extensively in the literature. Due to the straightforward implementa- 
tion, iterative methods are also attractive for solving nonlinear inverse problems. In 
this paper we will consider a class of inexact Newton methods. To motivate, let x s n 
be a current iterate. We may approximate F{x) by its linearization around x^, i.e. 
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F(x) rts F(x 5 n ) + F'{x 5 n )(x — x 5 n ). Thus, instead of (1.1) we have the approximate 
equation 

(1.3) F'(x s n )(x-x s n ) = y 5 -F(x s n ). 

If F'{x s n ) is invertible, the usual Newton method defines the next iterate by solv- 
ing (1.3) for x. Computing the exact solution of (1.3) however can be expensive 
in general even the problem is well-posed. Thus, one might prefer to compute 
some approximate solution at certain accuracy and use it as the next iterate. This 
motivates the inexact Newton methods in [2] where for well-posed problems the 
convergence was carried out when the next computed iterate x s n+1 satisfies 

(1.4) \\F{x s n ) -y s + F'(x s n )(x s n+1 - x s n )\\ < ^ n \\F(x s n ) y s \\ 

at each step with the forcing terms fj, n € (0, 1) being uniformly bounded below 
1. For nonlinear ill-posed inverse problems, F' (x n ) in general is not invertible and 
(1.3) usually is ill-posed. Therefore one should use the regularization methods to 
solve (1.3) approximately. Let {g a } be a family of spectral filter functions. We can 
apply the linear regularization method defined by {g a } to (1.3) to produce the next 
iterate. This leads to the following inexact Newton method 

(1-5) 4+i =<- 9 an {F'{x 5 n )*F'{x 5 n )) F'(x 5 n r {F(x 5 n ) y s ) , 

where Xq := x G D(F) is an initial guess of x^ and {a n } is a sequence of positive 
numbers. By taking g a to be various functions, (1.5) then produces the nonlinear 
Landweber iteration [5], the Levenberg-Marquardt method [3, 7], the exponential 
Euler iteration [6], and the first-stage Runge-Kutta type regularization [10]. 

In this paper we will consider the inexact Newton method (1.5) in a unified 
way by assuming that {a n } is an a priori given sequence of positive numbers with 
suitable properties. We will terminate the iteration by the discrepancy principle 

(1.6) \\F(x s ns )-y s \\<rS<\\F(x s n )-y s \\, < n < n s 

with a given number r > 1 and consider the approximation property of xf l/j to x^ 
as S — > 0. For a large class of spectral filter functions {g a } we will establish the 
convergence of a;* to x^ as S — > and derive the order optimal convergence rates 
for the method defined by (1.5) and (1.6). Our work not only reproduces those 
known results in [5, 7, 6, 10] but also presents new convergence results and new 
methods. Furthermore, our convergence analysis provides new insights into the 
feature of the inexact Newton regularization methods. 

In the definition of the inexact Newton method, one may determine the sequence 
{a n } adaptively during computation. In [3] the Levenberg-Marquardt scheme was 
considered with {a n } chosen adaptively so that (1.4) holds and the discrepancy 
principle was used to terminate the iteration. The order optimal convergence rates 
were derived recently in [4]. The general methods (1.5) with {a n } chosen adaptively 
to satisfy (1.4) were considered later in [11, 9], but only suboptimal convergence 
rates were derived in [12] and the convergence analysis is far from complete. The 
methods of the present paper is essentially different in that the sequence [a„] is 
given in an a priori way which has the advantage of saving computational work. 
We hope, however, the work of the present paper can provide better understanding 
on the methods with {a n } chosen adaptively. 

This paper is organized as follows. In Section 2 we first formulate the conditions 
on {a n }, {g a } and F, and state the main results on the convergence and rates 
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of convergence for the methods defined by (1.5) and (1.6), we then give several 
examples of iteration methods that fit into the framework (1.5). In Section 3 we 
prove some crucial inequalities which is frequently used in the convergence analysis. 
In Section 4 we derive the order optimal convergence rate result when x — 
satisfies certain source conditions. In Section 5 we show the convergence property 
without assuming any source conditions on x — . Finally in Section 5 we present 
numerical examples to test the theoretical results. 



2. Main results 

In order to carry out the convergence analysis on the method defined by (1.5) 
and (1.6), we need to impose suitable conditions on {«„}, {g a } and F. For the 
sequence {a n } of positive numbers, we set 



n 1 

(2.1) S_1=0, Sn--=Y,— 



— a, 



n = 0,1, 



We will assume that there are constants Cq > 1 and C\ > such that 

(2.2) lim s n — oo, s n +i < cos n and < a n < ci, n = 0, 1, • • • . 

n— 7-oc 

For the spectral filter functions {g a }, we will assume the following two conditions, 
where C denotes the complex plane. 

Assumption 1. For each a > 0, the function 

1 



VaW ■= 5a(A) - 



a + A 



extends to a complex analytic function defined on a domain D a C C such that 
[0, 1] C D a , and there is a contour T a C D a enclosing [0, 1] such that 

(2.3) \z\ > \a and ^ + ^ < b , Vz e T a , a > and A e [0, 1], 

2 | z — A | 

where bo is a constant independent of a > 0. Moreover, there is a constant bi such 
that 

(2.4) jT \<p a (z)\\dz\<h 
for all < a < c\ . 

Assumption 2. Let {a n } be a sequence of positive numbers, let {s n } be defined 
by (2.1). There is a constant b 2 > such that 

n 

(2.5) 0<X v Y[r ah {X)<(8 n -8 j - 1 )- v , 

k=j 
n 

(2-6) 0<X v g aj (X) 11 r ak {\)<b 2 — {s n - Sj . 1 )- v 

k=j+l J 

for 0<f<l,0<A<l and j = 0, 1, • • • , n, where r a (A) := 1 — \g a (X) is the 
residual function. 
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By using the spectral integrals for self-adjoint operators, it follows easily from 
(2.3) in Assumption 1 that for any bounded linear operator A with ||A|| < 1 there 
holds 

(2.7) \\ {zI - A *A)-\A*AY\\<^- u 

for z eT a and < v < 1. Moreover, since Assumption 1 implies ip a (z) is analytic 
in D a for each a > 0, there holds the Riesz-Dunford formula (see [1]) 

(2.8) ^ a(A *A) = ^-j^ Va (z)(zI-A*A)- 1 dz 

for any linear operator A satisfying ||^4|| < 1. 

As a simple consequence of (2.5) in Assumption 2, we have for < v < 1 and 
a > that 

n 

(2.9) O^A^a + A)- 1 [] r Qfc (A) < 2a"- 1 (1 + a(s„ - 

fc=j+i 

for all < A < 1 and j = 0, 1, • • • , n, see [8, Lemma 1]. 

For the nonlinear operator F, we need the following condition which has been 
verified in [5] for several nonlinear inverse problems. 

Assumption 3. (a) There exists K > such that 

(2.10) F'(x) = R(x,x)F'(x) and \\I - R(x, x)\\ < K \\x - x\\ 

for allx,x& S p (xt) c D(F). 

(b) F is properly scaled so that ||F'(a;)|| < min{l, y/a~o} for all x e B p (x' f ). 

The condition (a) in Assumption 3 clearly implies that \\F' (x)\\ is uniformly 
bounded over B p (x' f ). Thus, by multiplying (1.1) by a sufficiently small number, 
we may assume that F is properly scaled so that condition (b) in Assumption 3 is 
satisfied. A direct consequence of Assumption 3 is the inequality 

\\F(x) - F(xt) - F'(x^)(x - x^)\\ < ^K \\x - a; t ||||F'(a; t )(a; - x*)\\ 

for all x G B p (x^), which will be frequently used in the convergence analysis. 

Now we are ready to state the first main result concerning the rate of convergence 
of xf lg to x^ as S — > when e :— x — x^ satisfies the sourcewise condition 

(2.11) x Q -x f = (F'(x^)*F'(x^)) u uj 

for some < v < 1/2 and lo G A/'(F'(a;^))- L C X, where ns is the integer determined 
by the discrepancy principle (1.6) with r > 1. 

Theorem 2.1. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 2, 
and let {a n } be a sequence of positive numbers satisfying (2.2). If xo — x^ satisfies 
the source condition (2.11) for some < v < 1/2 and lj e ^(F'ix^)) 1 - C X and if 
Kq\\lu\\ is suitably small, then 

iK-^ll <ai^n 1/(1+2,y) ^ /(1+2,y) 

for the integer ns determined by the discrepancy principle (1.6) with t > 1, where 
C„ > is a generic constant independent of 6 and \\u)\\. 
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Theorem 2.1 shows that the method (1.1) together with the discrepancy principle 
(1.6) defines an order optimal regularization method for each < v < 1/2. This 
result in particular reproduces the corresponding ones in [5, 7, 6, 10] for various 
iterative methods even with an improvement by relaxing r > 2 to r > 1. 

Nevertheless, Theorem 2.1 does not provide the convergence of x s n& to as 
(5 — > if there is no source condition imposed on xq — x^ . In the next main result 
we will show the convergence of x s ns to x^ as 5 — > if {a n } is a geometric decreasing 
sequence, i.e. 

(2.12) a n =a r n , n = 0,l,--- 

for some a n > and < r < 1, which is one of the most important cases in 
applications. 

Theorem 2.2. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 
2, and let {a n } be a sequence of positive numbers satisfying (2.12). If x — x^ G 
N{F'(x J< )) i - and K \\xo — x^W is suitably small, then 

lim a;* = x^ 

s=o ns 

for the integer ns determined by the discrepancy principle (1.6) with r > 1. 

Theorem 2.2 extends the corresponding result in [7] for the Levenberg-Marquardt 
method to a general class of methods given by (1.5). The convergence result in 
Theorem 2.2 still holds if (2.12) is replaced by the condition 

(2.13) d r n < a n < d x r n , n = 0,l,--- 

for some constants < do < d\ < oo and < r < 1. In fact, the proof of Theorem 
2.2 given in Section 5 requires only {a n } to satisfy (2.2) and (5.1) which can be 
achieved if {a n } satisfies (2.13). It would be interesting if such a convergence result 
can be proved for a general sequence {a n } satisfying (2.2) only. This, however, 
remains open; new technique seems to be explored. 

We conclude this section with several examples of the methods (1.5) in which 
the spectral filter functions {g a } have been shown in [8] to satisfy Assumptions 1 
and 2: 

(a) We first consider for a > the function g a given by 

(a + \) N -a N 

where N > 1 is a fixed integer. This function arises from the iterated Tikhonov 
regularization of order N for linear ill-posed problems. The corresponding method 
(1.5) becomes 

«n,J+i - «n,J - M + F'ixirF'ixi))' 1 F'(x s n )* (F(x 5 n ) ~y 5 - F'(x 5 n )(x s n - «„,,)) , 

1 = 0, ■■■ ,N-1, 

x n+l = u n,N- 

When N = 1, this is the Levenberg-Marquardt method (see [3, 7]). 

(b) We consider the method (1.5) with g a given by 



g a (X) = \(l-e-^ a ) 
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which arises from the asymptotic regularization for linear ill-posed problems. In 
this method, the iterative sequence {x s n } is equivalently defined as x 5 n+l := x(l/a n ), 
where x(t) is the unique solution of the initial value problem 

j t x(t) = F'(xi)* (y 5 ~ F(x s n ) + F'(xi)(x s n - x(t))) , t > 0, 
x(0)=x 5 n . 

This is the so called exponential Euler iteration considered in [6]. 

(c) For < a < 1 consider the function g a given by 

(2-14) g a (X) = \l - A)' = 1 ' (1 ' A)[1/ ° 1 

which arises from the linear Landweber iteration, where [1/a] denotes the largest 
integer not greater than 1/a. The method (1.5) then becomes 

«n,i+i = «n,i ~ F'(x s n y (F(x s n ) -y 5 - F'(x s n )(x 5 n - u n j)) , < I < [l/a n ] - 1, 

X i.+ 1 — u n,[l/a n ]- 

When a n = 1 for all n, this method reduces to the Landweber iteration in [5]. 

(d) For < a < 1 consider the function 



m [ V ^1 n^^^- ^ 1 — (1 + A) - ! 1 /"! 

<?a(A) = 2^ (1 + A) = 



arising from the Lardy method for linear inverse problems. Then the method (1.5) 
becomes 

«n,i+i = «„,« - (/ + F'ixiyF'ixi))' 1 F'(x s n r (F(x s n ) -y 5 - F'(x 5 n )(x 5 n - u n ,)) , 

I = {),■■■ ,[l/a„]-l, 

x n+l = u n,[l/a„] • 

When a n = 1 for all n, this is the so called first-stage Runge-Kutta type regular- 
ization considered in [10]. 



3. Some crucial inequalities 

The following consequence of the above assumptions on F and {g a } plays a 
crucial role in the convergence analysis. 

Lemma 3.1. Let {g a } satisfy Assumptions 1 and 2, let F satisfy Assumption 
3, and let {a n } be a sequence of positive numbers. Let T = F'(x^) and for any 
x e B p (xi) let T x = F'(x). Let < a < 1/2. Then for < b < 1/2 + a there holds 

n 

(T*T) a J] r ak {T*T)[g aj {T*T)T* -g aj {T*T x )T*]={T*T) b S j 
fe=j+i 



7 



for some bounded linear operator Sj : Y — > X satisfying 1 

ii^-ii ^-(sn-s^r^-^KoWx-^w, 

where j = 0, 1, • • • , n. 

Proof. Let r] a (X) = (a + A) -1 and <p a (\) = p Q (A) — (a + A) -1 . We can write 

n 

(T*T) a 11 r ak (T*T) [g aj (T*T)T* - g aj (T*T X )T*^ = J, + J 2 + J 3 , 
k=j+i 



where 



,h:={T*TT ]"[ r ak (T*T)g aj (T*T)[T*-T*}, 



k=j+i 

n 

J 2 :=(T*T) a H r ak (T*T)[ Vaj (T*T)- Vai (T*T x )]T:, 
k=j+l 
n 

J 3 :=(T*T) a H r ak (T*T)[ip aj (T*T)-y aj {T*T x )\T*. 

k=j+l 

It suffices to show that for each J; there holds Ji = (T*T) V Si for some bounded 
linear operator Si : Y — > X satisfying the desired estimate. We will use the polar 
decomposition for linear operators which implies that T* = (T*T) 1//2 C7 for some 
partial isometry U : Y — > X. 

By using Assumption 3 we have T* - T* = T*(I - R x )* , where R x := R(x, #t). 
This together with the polar decomposition on T* gives 

(3.1) T* -T* = (T*T) 1/2 U(I - R x )*. 

Consequently we can write J\ — (T*T) b Si with 

n 

Si = (T m T) 1 ' 2+a - b g aj {T*T) JJ r ak (T*T)U(I - R x )* . 

k=j+i 

Since < 1/2 + a — b < 1, it follows from Assumption 2 that 

l|Sl||< Sup [ A l/2+a-6 (A) TT r (A) ) \\I-R X \\ 
\ k=j + l J 

<—(8 n -8 j - 1 )- 1 ' 2 - a+b K \\ X -X*\\. 

This shows the desired conclusion on J\. 
Next we consider J 2 . Note that 

Vaj (TT) - rjaj {T*T X ) = ( aj I + T*T)~ 1 T*(T X - T)( aj I + T^y 1 
+ ( aj I + TT) _1 (T* - T*)T x (a 3 I + T*T X )~\ 



Throughout this paper we will always use C to denote a generic constant independent of S 
and n. We will also use the convention <I> < , 3> to mean that <I> < C$> for some generic constant C. 
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Plugging this formula into the expression of J 2 , and using the polar decomposition 
on T* and the identity (3.1), we have J 2 = (T*T) b S 2 , where 

n 

S 2 = 1~[ r ^ k ( T * T )( a J I + T*T)- 1 (T*T) 1 / 2+a - b U(T x - T)( aj I + T* x T x y x Tl 

k=J + l 

n 

+ II r ah (T*T){a j I + T*T)- x {T*T) x / 2+a - b U(R x - I)*T x T*{ aj I + T x T*y\ 
k=j+i 

With the help of Assumption 3 we have 

\\(T X - T)( aj I + T*T X )~ 1 T*\\ < K \\x - x^\\. 
Therefore, it follows from (2.9) that 

||S 2 ||< sup Ix^+^iaj + X)- 1 f[ r ak (X) ) \\{T X - T){ aj I + T*T x y'T* x \\ 



0<A<1 



fe=j+l 



+ sup AV^-^^+A)- 1 [] r ak (\)\\\{R x -iyT x T* x { aj I + T* x T x )^\\ 

< a a r b - 1/2 (1 + aj (s n - Sj )r 1,2 - a+b K \\x - J\\ 
= —{s n -s j ^)- 1 l 2 - a+b K4x-x% 

Otj 

It remains to consider J3. Since Assumption 1 implies that cp aj (z) is analytic in 
D ajl we have from the Riesz-Dunford formula (2.8) that 



(3.2) = j T S ' : (z]L J (Z]d '-- 

where 



Lj(z) := (T*T) a [] r ak (T*T)[(zI -T^y 1 - (zl -T*^)- 1 ]^. 
k=j+i 

Using the decomposition 

(zl - rT)- 1 - (zl - T*^)- 1 = (zl - T * T )-i T *(T - T x )(zl - t*^)- 1 

+ (zl - t*T)-\T* - T*)T x (zI - T*T X ) _1 

together with the polar decomposition on T* and the identity (3.1), we obtain 
Lj(z) = (T*T) b Lj(z), where 

n 

Lj(z) = Y[ r ak {T*T){zI -T*Ty 1 {T*T) 1 ^ +a - b (T -T x )(zl -T^Ty^T* 
k=j+i 

n 

+ Yi r ak (T*T)(zI — T*Ty 1 (T*T) 1 / 2+a ~ b U(I — R x )*T x T*(zI — T X T*) _1 . 

k=j+l 

Combining with (3.2) gives J 3 = (T*T) b S 3 , where 



S z = ^-f r <P ai (z)Lj(z)dz. 
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We need to estimate || 5*311. We first estimate Lj(z) for z e Y aj . With the help of 
Assumption 3 and (2.7), we have 

|| (t - T x ){zi - r*r x ) _1 r*|| <k q \\x-x% 

Since \z\ > aj/2 and \z — A| _1 < b (\z\ + A) -1 for z e T aj , we have from (2.9) that 



Lj(z)\\< sup AV^-^-AI" 1 [] r ak (X)]K \ 



x — x*\ 



0<A<1 



k=j+l 



< sup [X^-Wzl+X)- 1 J] r ak (X)}K \\x-^\\ 

< ^l-i-l/2 (1 + ( Sn _ Sj .)l«l)~ 1/2 ~ a+6 ^Olk - St|| 

< «r b - 1/2 (1 + (s n - Sj )a,)- 1/2 - a+6 *o||* - xt|| 

= — (8 n -8 j -l)- 1 ' 2 - a+b K \\x-x1\\. 

Therefore, it follows from Assumption 1 that 

l|S 3 || <-(*„-. s^r^+^M^-^ll / \^A^\\dz\ 

<^-(a n -a j - 1 )- 1 / 2 - a ^Ko\\x-x% 

The proof is therefore complete. □ 

In the proof of Theorem 2.2 we will also need the following inequality which can 
be obtained by essentially the same argument in the proof of Lemma 3.1. 

Lemma 3.2. Let {g a } satisfy Assumptions 1 and 2, let F satisfy Assumption 
3, and let {a n } be a sequence of positive numbers. Let T = F'(x^) and for any 
x € B p (xi) let T x = F'(x). Then for < fi < 1/2 there holds 

n 

(T*TT 1] r ak (T*T)[g a3 (T* x T x )T* x -g aj (T;T !i )T* x ] 
k =J +i 

< i-(s„ - s^)-*- 1 ' 2 (1 + K \\x -x^\\) K \\x - x\\ 

for all x, x <G B p (x'), where j = 0, 1, • • • , n. 

4. Rates of convergence: proof of Theorem 2.1 

We begin with the following lemma which follows from [4, Lemma 4.3] and its 
proof; a simplified argument can be found in [8]. 

Lemma 4.1. Let {a n } be a sequence of positive numbers satisfying a n < c\, and 
let s n be defined by (2.1). Let p > and q > be two numbers. Then we have 

n (I, max{p, q} < 1, 

V — (s„ - Sj^-Psj" < C sl- p - q \ log(l + s n ), max{p, q} = 1, 

i=o Uj { sT x{p ' q} -\ max{p,g}>l, 

where Co is a constant depending only on c\, p and q. 
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In order to derive the necessary estimates on x 5 n — x\ we need some useful 
identities. For simplicity of presentation, in this section we set 

e 5 n :=x s n -x\ T:=F'{x^) and T n := F'(x 5 n ). 

It follows from (1.5) that 

= e S n - 9an [T*T n ) T*{F{x s n ) - y s ). 

Let 

u n :=F(x s n )-y-T(x s n -x*). 

Then we can write 

el +1 = e s n -g an {T*T)T*{F{xt)-y s ) 

- [ 9an {T:T n )T* n - g an (T*T)T*} (F(x 5 n ) - y 6 ) 
= r an (T*T)e 5 n - 9ctn (T*T)T*(y - y 5 + u n ) 
(4-1) - [g an (T:T n )T: - g an (T*T)T*\ (F(x 5 n ) - y 5 ). 

By telescoping (4.1) we can obtain 

n n n 

e S n+ i = II raAT*T)e - £ J] r ak {T*T)g a] {T*T)T*{y - y s + Uj ) 

3=0 3=0 k=j+l 

n n 

( 4 - 2 ) "Ell r «fc(^*^) [9a 3 {T*Tj)T* - g aj (T*T)T*~\ (F(x 5 j) — y s ). 

j=0 fc=j+l 

By multiplying (4.2) by T := F'(x^) and noting that 

n n n 

(4.3) /-^ I] r ak (TT*)g aj (TT*)TT* = l[r aj (TT*), 

3=0 k=j+l j=0 

we can obtain 

Te s n+1 -y 5 + y 



n n 



= Tl[r ai (T*T)e n + l[r a] (TT*)(y-y s )-J2 H r ak (TT*)g aj (TT*)TT* 

3=0 3=0 3=0 k=j+l 

(4.4) 



n n 



- E T II (T*T) [g aj (T*Tj)T* - g aj (T*T)T*] (F(xf) - y 5 ). 

j=0 fc=j + l 

Based on (4.2) and (4.4) we will prove Theorem 2.1 concerning the order optimal 
convergence rate of x ns to x' when eo := xq — x* satisfies the source condition (2.11) 
for some < v < 1/2 and lo e jV(F' '(x^)) 1 - C X. We will first derive the crucial 
estimates on ||e^|| and ||Te£||. To this end, we introduce the integer hs satisfying 

[ b] Sn * S 2co\\u\\ n ' " 



where c > 1 is the constant appearing in (2.2). Such n$ is well-defined since 
s„ — » oo as n — > oo. 
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Proposition 4.1. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 
and 2, and let {a n } be a sequence of positive numbers satisfying (2.2). If xo — x' 
satisfies (2.11) for some < v < 1/2 and uj e Af(F' (x^)) 1 - C X and if K \\u\\ is 
suitably small, then there exists a generic constant C* > such that 

(4.6) ||e* || < C.a-"\\ U \\ and \\Te s J < C^-^M 

and 

(4-7) \\Te s n -y s + y\\ < (c + C^olMIK^IMI + 5 

for all < n < n$ . 

Proof. We will show (4.6) by induction. By using (2.11) and ||T|| < v / ao it is easy 
to see that (4.6) for n = holds if C* > 1. Next we assume that (4.6) holds for all 
< n < I for some I < ns and show (4.6) holds for n = I + 1. 
With the help of (2.11) we can derive from (4.2) that 



llef+ill < 



i 



Y[r aj {T*T){T*T) v uj 



i i 



i i 



E II r ak (T*T)g aj (T*T)T*(y-y s + Uj ) 

j=0 k=j+l 



E II r ^ ( T * T ) [9>v i T i T o) T i - 9 aj [T*T)T*] [Fix]) - y 5 ) 

j=0 k=j+l 

Thus we may use Assumption 2 and Lemma 3.1 with a = b = to conclude 
||e? +1 || < sr\H + b 2 E ^(si ~ Sj -i)- 1/2 (8 + \\uj\\) 



J=0 3 



I 



(4.8) + CE ^ - Sj -i)- 1/2 ^o|| ej ||||F(4) - y% 

Moreover, by using (2.11), Assumption 2 and Lemma 3.1 with a = 1/2 and 6 = 0, 
we have from (4.4) that 



ITe: 



i+i 



y s + y\\ <s 



-I/-1/2, 



CO 



1 1 

+6+b 2 y2—(si-s j - 1 )- i \\u j \\ 

< 4 rv • 



j=0 J 



(4.9) 



+ CE ~ s^y'KoWejWWFix*) y s \\. 



1=0 3 



With the help of Assumption 3 and the induction hypotheses, it follows for all 
< j < I that 

|| % -||<^ol| e |lll|r e |||<x ||^|lV^ 1/2 - 



2c 



_ =r «_|| fa; || s -«'-l/2 } 0< j<l 



(4.10) 

By using the fact 

(4.H) _ r 

and the induction hypotheses we have 

(4-12) ||F(zf) - y s \\ < 6 + \\Te% + || Uj || < \\co\\ S -- 1/2 . 
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In view of the estimates (4.10), (4.12), the induction hypothesis on ||ej|| and the 
inequality 

(4.13) E^(-'--i-0- 1/a <^ Va 

3=0 J 

for some generic constant c 2 , which follows from Lemma 4.1, we have from (4.8) 
and (4.9) that 

||e? +1 || < \W\\s^ + c 2 s) /2 5 + CX |M| 2 ]T ^(si - 8j - 1 )- 1 ^af v - 1/2 

3=0 aj 

and 

||Tef +1 -y s + y\\ < Ms;- 1 ' 2 + S + CtfoNI 2 £ - s^sf^ 2 . 
With the help of Lemma 4.1, v > 0, (4.11) and (2.2) we have 

llef+ill < (l + ^J c ^ + C#o|Ml) Msi" 

and 

||Te? +1 -y 5 + y\\<6 + (l + CK \\u>\\) |M|*r"~ 1/2 

(4.14) < S + (co + CK \\u\\) ||a;||s;7r 1/2 - 

Consequently ||ef +1 || < C^wHs^ if C* > 2 + ^jCqc 2 and ^o|M| is suitably small. 
Moreover, from (4.14), (4.11) and (2.2) we also have 

iir e f +1 ii<2 ( 5+( Co +c^oi^ii)i^i| S r;r 1/2 



< 



(^Y + c o + cxo|^||)||^|| s r + T 1/2 



<c^lh+T 1/2 



if C* > 2co + and i^olM is suitably small. We therefore complete the proof of 
(4.6). In the meanwhile, (4.14) gives the proof of (4.7). □ 

From Proposition 4.1 it follows that x n € B p (x^) for < n < hs if ||w|| is 
sufficiently small. Furthermore, from (4.10) and (4.12) we have 

(4-15) ||F(4)-i,-Te*||<Jiro|M|V , '- 1/2 
and 

(4-16) \\F(x s n )-y s \\<\\u\\s;r 1/2 
for < n < hs- 

In the following we will show that ns < n$ for the integer ns defined by (1.6) 
with r > 1. Consequently, the method given by (1.5) and (1.6) is well-defined. 

Lemma 4.2. Let all the conditions in Proposition 4-1 hold. Let r > 1 be a given 
number. If Xq — x' satisfies (2.11) for some < v < 1/2 and uj G jV(F' (x^)) 1 - C X 
and if Kq\\uj\\ is suitably small, then the discrepancy principle (1.6) defines a finite 
integer ns satisfying ns < ns . 
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Proof. From Proposition 4.1, (4.15) and v > it follows for < n < h$ that 
\\F(x s n ) y 5 \\ < \\F(x s n ) y Te s J + \\Te s n - y s + y\\ 

< CKoM's- 2 ^ 2 + (c + CK \\u>\\) s-'-^M + S 

By setting n — n$ in the above inequality and using the definition of fis we obtain 



l|F(4J - y 6 \\ < ( 1 + ^ + CK o\H ) s < rs 



2 

if ifolMI is suitably small. According to the definition of ns we have ns < ns- □ 

4.1. Completion of the proof of Theorem 2.1. From (4.2), the source condi- 
tion (2.11), the polar decomposition on T* , and Lemma 3.1 with a = and b = v 
it follows that 

(4.17) e s n+1 = (T*T) u w n , 

where; 



w n := [] r ai {T*T)u - ]T Sj(F(x!) y s ) 



n n 



E II ^ fc (r*r).9 Q3 (T*T)(r*r) 1 /2-^( ?y _/ + Uj) . 

3=0 k=j+l 

With the help of Assumption 1 and Lemma 3.1 we have 



«ll £ IMI + E ^( s ™ - Sj -i)- 1/2+ ^ol| ej ||||F(.^) - /|| 

3=0 3 

n 

+ J2-^- s ^r 1/2+ "(s +kii). 



a, 



In view of (4.15), (4.16), Proposition 4.1, Lemma 4.1 and (4.5) it yields for < n < 
ns that 



kJ<iMi + ^E-( s «-^-ir 1/2+,y 



n 1 

+ /f ii-ii 2 E-( s «-^)- 1/2+ V^ 1/2 



j=0 3 

<imi+4 /2+ ^<ni- 

Since Lemma 4.2 implies that na < n^, we have ||u; nj _i|| < IMI- On the other 
hand, it follows from (4.17), Assumption 3 and the definition of ns that 

\\T(T*Ty w^W = ||Te n< || < ||F«) - y\\ < 5. 

Therefore, by using (4.17) and the above two estimates, we have from the interpo- 
lation inequality that 

ii4ii < ii^-iii^+^iin^T)^^!!! 2 ^ 2 ^ 

<C iy || W || 1 /( 1 + 2iy )(5 2 ^( 1 + 2 ^. 
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This gives the desired estimate. 

5. Convergence: proof of Theorem 2.2 

In this section we will show Theorem 2.2 concerning the convergence of x s n& to 
as 5 — > without assuming any source conditions on e := x — X s . The sequence 
{a n } is now given by (2.12). It is easy to see that l/a n < s n < 1/((1 — r)a n ) and 

n , 

(5.1) ^-( S n- S M)-V<Cia n -" 

j=0 1 

for < n < 1, where Ci is a constant depending only on r and /x. We remark that 

(5.1) may not be true for a general sequence {a n } satisfying (2.2). 

We first show that the method given by (1.5) and (1.6) is well-defined. To this 
end, we introduce the integer h$ satisfying 

(5.2) s^ 2 < t=^- < s-V\ 0<n<h s . 

^co||eo|| 

Since s n — > oo as n — » oo, such h$ is well-defined. 

Lemma 5.1. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 2, 
and let {a n } be a sequence of positive numbers satisfying (2.12). Let r > 1 be a 
given number. If K \\eo\\ is suitably small, then there is a constant C* such that 

(5.3) Il4||<a||e || and \\Te 6 n \\ < aiM^ 1 / 2 

for < n < hs, and the discrepancy principle (1.6) defines a finite integer ns 
satisfying n$ < hs- 

Proof. We prove (5.3) by induction. By using ||T|| < y/cto, it is easy to see that 
(5.9) is true for n = if C* > 1. Next we assume that (5.9) holds for all < n < I 
for some I < hs, and show that it is also true for n = I + 1. By a similar argument 
in the proof of Proposition 4.1 we obtain 

(5.4) ||e? +1 || < || eo ||+ C2S; 1/2 <5 + C/fo||eo|| 2 E— ( s '-^'-i) _1/2s 7 1/2 



and 



1 

(5.5) ||Tef +1 - j/ 4 + y\\ < \\e Q \\ S ; 1/2 + S + CK Q \\e \\ 2 ]T — (*i - Sj-^aJ 1 ' 2 . 

3=0 Uj 



By using (5.2) and Lemma 4.1 we obtain from (5.4) that 

l|e?+i|| < (l + ^c^ + CKoWe^ ||e || < C.||e || 

if C* > 2 + ^c c 2 and i^o|| e o|| is suitably small. On the other hand, by using 
(5.1) with /i = 1/2 and (2.2) we obtain from (5.5) that 

l|Te? +1 - V 5 + V\\ < 8 + (1 + C^o||e ||)||e || S - 1/2 

(5.6) < 5 + (c + Ci^olleolDlleolls^ 1 / 2 - 

Consequently, we have from (5.2) that 

||Te? +1 || < + CQ + C^o||eo||) lleoll^+Y 2 < Clleoll^+Y 2 
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if C* > 2c + -^j- and ifo||e | is suitably small. We thus complete the proof of 
(5.3). 

Note that the above argument in fact shows also that 

lire* -y 5 + y\\<5+ (c + a^o||eo||)||e |K 1/2 , < n < h s . 

Thus, by the similar argument in the proof of Lemma 4.2 we can derive ) — 

y S \\ < t5 if Ko\\eo\\ is suitably small. According to the definition of ns we obtain 
n$ < n$. □ 

In the remaining part of this section we will show x 5 ns — > as S — > 0. We will 
achieve this by first considering the noise free iterative sequence {x n } defined by 
(1.5) with y s replaced by y, i.e. 

(5.7) x n+1 =x n -g an (F'(x n )*F'(x n ))F'(x n y(F(x n )-y) 

and showing that x n —> x^ as n — > oo. We then derive the stability estimate on 
\\ x n ~ x n\\ f° r < n < ns together with other related estimates. With the help of 
the definition of ns, we will be able to show the convergence of x 5 n to ^ as 5 — > 0. 

5.1. Convergence of the noise free iteration. In this subsection we will show 
the convergence of x n to as n — > oo. We first show that if xq — x^ e 1Z(F'(x^)*) 
then x n — > x^ as n — > oo. We then perturb the initial guess xq to be xo such that 
x - x^ e 1l(F'(xi)*) and define {x n } by 

(5.8) x n+1 =x n - g an (F'(x n )*F'(x n )) F'{x n )*{F(x n ) - y). 



Since xq — x^ e A/"(-F'(a^))~ L = 7Z(F'(x^)*), such io can be chosen as close to xq 
as we want. We then show that {x n } is stable relative to the change of xq. This 
allows us to derive the convergence of {x n }- 

We start with several lemmas. We first show that x n is well-defined for all n and 
satisfies certain estimates. 

Lemma 5.2. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 
2, and let {a n } be a sequence of positive numbers satisfying (2.12). If K \\e \\ is 
suitably small, then 

(5.9) HcH < 2||eo|| and \\Te n \\ < 2co||e ||s r ; 1/2 
for n = 0, 1, • • • , where e„ := x n — x^ . 

Proof. This result can be obtained by the same argument in the proof of Lemma 
5.1. □ 

Lemma 5.3. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 2, 
and let {a n } be a sequence of positive numbers satisfying (2.12). If e = (7 1 *T) 1 / 4 a; 
for some lo € A/^T)- 1 C X and K \\e \\ is suitably small, then 

(5.10) ||e„|| < 2CQIMK 1 / 4 and \\Te n \\ < 2c ||c;|| s" 3 / 4 
for n = 0, 1, • • • . 

Proof. We prove (5.10) by induction. By using ||T|| < ^ and e = {^Tf^uj, it 
is easy to see that (5.10) is true for n — 0. Next we assume that (5.10) holds for 
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all < n < I, and show that it also holds for n = I + 1. By a similar argument in 
the proof of Proposition 4.1 we obtain 



||e m || < sr 1/4 |MI +b 2 J2 ^ ^-ir 1/2 \\F(^) V Tej 

3=0 3 

(5.11) + CJ2 sj-J-WKoWejWWFixj) y\\ 



j=o J 



and 



||Te,+i|| < s t 3/4 |M| +b 2 J2^( Sl ^ sj-^WFixj) -v- Te 3 \ 

3=0 j 

1 1 

(5.12) + CJ2 —('I ~ aj-^KoWejWWnxj) - vl 



3=0 J 

With the help of Assumption 3, Lemma 5.2 and the induction hypotheses, we have 
for < j < I that 

\\F{xj)-y-Tej\\ < K \\ej\\ \\Tej\\ < CK \\e \\ \W\\sj 3/ \ 
\\F( Xj ) y\\ < \\T ej \\ + \\F( Xj ) y Te 3 \\ < \\co\\sf/ 4 . 

Therefore, by using Lemma 4.1, we obtain from (5.11) that 

||e/+i|| < s,~ 1/4 ||u;|| + Cifo||eo||||w|| ^ — ( s ' - s j-i)~ 1/2s 7 3/4 



3=0 J 



<(l + C^o||eo||)|| W || S r 1/4 , 



while by using (5.1) with ^ = 3/4 we obtain 

/ 



\Te l+1 \\ < 8 f\\u>\\ + CK \\eo\\ \\u>\\ £ s^sf 1 * 



< (l + CJfolleolDHwHs," 



LA. n 

3=0 3 
3/4 



Thus, by using s; + i < c sj, we obtain for suitably small ifo||eo|| that ||ej+i|| < 
2co|| an( l ll^ e (+i|] — 2co||w||s;_|_/ . The proof is therefore complete. D 

We remark that the crucial point in Lemma 5.1 is that it requires only the 
smallness of -Koll e olli which is different from proposition 4.1 where the smallness of 
-KolMI is needed. This will allow us to pass through the approximation argument 
due to the perturbation of the initial guess. 

We now derive a perturbation result on \\x n — x n \\ and ||T(x„ — x n )\\ relative to 
the change of the initial guess. For simplicity of the presentation we set 

- = x n x\ T n = F (x n ), T n = F (x n ). 
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It follows from (5.7) and (5.8) that 



x n+ i - x n+1 = x n -x n - g an {T*T n )T*{F{x n ) - y) + flQB (f*f n )f*(F(x n ) - y) 
= r a jT*T){x n - x n ) - g an (T*T)T* {F(x n ) - F(x n ) - T(x n - x n )) 

- [g Q „(T„*T„)T„* - g an (T*T)T*] (F(x n ) - F(x n )) 

- g an {T*T n )T* - g an {T*T n )T*] (F(x n ) - y) . 
By telescoping this identity we obtain 

n 

x n +i - x n+ i = Y[ r ak (T*T)(x - x ) 

k=0 

n n 

"E II (T*T)g aj (T*T)T* (F( Xj ) - F( Xj ) T( Xj - %)) 
j=o fe=i+i 

n n 

"E II (T*T) [g aj (T;T 3 )T; g aj (T*T)T*} (F( Xj ) F( Xj )) 

j=0 k=j+l 



(5.13) 



E II r « k (T*T) [g^T^T* g^f^f*] (Fix,) y) 

3=0 k=j+l 



Lemma 5.4. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 2, 
and let {a n } be a sequence of positive numbers satisfying (2.12). If i^o||eo|| and 
-?^o||eo|| are suitably small, then 

(5.14) \\x n - x n \\ < 2\\x - xa\\ and \\T(x n - x n )\\ < 2c s~ 1/2 \\x - x \\ 
for n = 0,1,- - ■ . 

Proof. We will show (5.14) by induction. Since ||T|| < y/ao, (5.14) holds for n = 0. 
In the following we will assume that (5.14) holds for < n < I, and show that it is 
also true for n = I + 1. 

In view of Assumption 2, Lemma 3.1 with a = b = 0, and Lemma 3.2 with /i = 0, 
it follows from (5.13) that 

\\x l+1 - x t+1 \\ < \\x - i || 



(5.15) 



1 1 

+ C E -( s < - *i-i)~ 1/2 \\ F (xj) - - - 

3=0 j 

+ C E ^ s^r^KoWejWWFixj) F(xj)\\ 
+ CJ2 -(^ - Sj-ir^KoWx, xj\\\\F(xj) - 2/M- 



Ctj 
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Next wc multiply (5.13) by T. By using Assumption 2, Lemma 3.1 with a = 1/2 
and 6 = 0, and Lemma 3.2 with fi = 1/2, we obtain 

\\T(x l+1 -x l+1 )\\<s; 1/2 \\x -xo\\ 
1 1 

+ C E -( s < - 'i-i)" 1 !!^) - - - xj)\\ 

3=0 a > 
1 1 

1 1 

(5.16) —(si - s^y'KoWx, XjUFixj) y\\. 

Cxi 

j=0 1 

From Lemma 5.2 and Assumption 3 it follows that 

(5.17) ||f - y || < ||Te,|| + tfolNIHTeJ < S ; 1/2 p ||. 
Moreover, By using Assumption 3 we have 

F( Xj ) - Fix,) - T( Xj - xj) = / [F'( Xj + t( Xj - xj)) - T] ( Xj - Xj )dt 

Jo 

= / [R(xj + t(xj — Xj), x' ) — l\ T(xj — xj)dt. 
Jo 

Consequently 

\\F(x 3 )-F(x 3 )-T(x 3 -x 3 )\\ < f \\R( Xj +t( Xj - Xj ), X ^)-I\\\\T( Xj - Xj )\\dt 

Jo 

^^odle.-H + II^IDIlT^-^ll- 
With the help of Lemma 5.2 it yields 

(5.18) \\F( Xj ) - F( Xj ) T( Xj Xj )\\ < K Q (||e || + ||e ||) \\T( Xj Xj )\\. 
This in particular implies 

(5.19) \\F( Xj ) - F( Xj )\\ <2\\T(x j -x j )\\. 

By virtue of (5.17), (5.18), (5.19) and the induction hypotheses, we have from (5.15) 
and (5.16) that 

\\xi+i - xi+i\\ < IK - x \\ 

l 

(5.20) + CK (\\eo\\ + \\e \\)\\x - x \\ ]T — (s, - s^t)- 1 ' 2 s^ 12 

o=o aj 

and 

\\T(x l+1 - x l+1 )\\ < s ; 1/2 \\x - x \\ 



1 1 

(5.21) + CJ^oClleoll + \\e Q \\)\\x Q - x \\ £ — (a, - ^-i)" 1 * 



; 

-1,-1/2 
3 



a 

3=0 
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With the help of Lemma 4.1 and (5.1) we can derive 

- x l+1 \\ < (1 + CK (\\e \\ + poll)) ||x - *o|| 
< 2p - x \\ 

and 

\\T(x l+1 - x l+1 )\\ < (1 + CK (\\eo\\ + Poll)) ^ 1/2 \\x - x \\ 
< 2c s^ 1 1 //2 |l x o - II 

if i^opoll and i^opoll are suitably small. The proof is thus complete. □ 

Theorem 5.5. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 and 
2, and let {a n } be a sequence of positive numbers satisfying (2.12). If eo <E ^(T) 1 - 
and Ko\\ eo || is suitably small, then 

(5.22) lim \\x n -x*\\ = and lim s]l 2 \\T{x n - x<)\\ = 
for the sequence {x n } defined by (5.7). 

Proof. Let < e < po|| be an arbitrarily small number. Since eo G Af^T) 1 - = 
1Z(T*), there is an xq € X such that eo := xq — e 1Z(T*) and po — foil < £■ 
Note that i^opoll < 2if po||- Thus, if X po|| is suitably small, then for the 
sequence {x n } defined by (5.8), it follows from Lemma 5.4 that 

\\x n - x n \\ < 2p - i || < 2e 

and 

s 1 J 2 \\T{x n - x n )\\ < 2c p - £ || < 2c £ 
for all n > 0. On the other hand, since e G 1Z(T*) = 1Z((T*T)^ 2 ) C 7^((T*T) 1 / 4 ), 

1 /2 

from Lemma 5.3 we have ||e n || — > and s n H^nH — > as n — > oo. Thus, there is 

1/2 

a n such that p„|| < e and s n ||T'e„|| < cqS for all n > n . Consequently 

P„|| < \\x n - x n \\ + \\e n \\ < 3e 

and 

4 /2 ||re„|| < s 1 J 2 \\T(x n -x n )\\+s 1 J 2 \\Te n \\ < 3c £ 
for all n > n . Since e > is arbitrarily small, we therefore obtain (5.22). □ 

5.2. Stability estimates. In this subsection we will derive the stability estimates 
on 1 1 x ^ ■ x ji || for < n < ns, where n$ is defined by (5.2). We will use the notations 

A := JV)**V)> A, := F'(x n )*F'(x n ), A s n := F' (x s n )* F> (x s n ). 
The main result is as follows. 

Proposition 5.1. Let F satisfy Assumptions 3, let {g a } satisfy Assumptions 1 
and 2, and let {a n } be a sequence of positive numbers satisfying (2.12). //ifopoll 
is suitably small, then 

(5.23) ii4-^ii< s y 2 ^ 

and 

(5.24) \\F{x* n ) - F(x n ) - y s + y\\ < (1 + CK \\e \\)S 
for < n < ns . 
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Proof. We first show (5.23) by establishing 

(5.25) \\x* n - x n \\ < 2b 2 c 2 s 1 J 2 5 and \\T(x s n - x n )\\ < 35 

for < n < hs, where 6 2 and c 2 arc the constants appearing in (2.6) and (4.13) 
respectively. It is clear that (5.25) is true for n = 0. Now we assume that (5.25) is 
true for all < n < I for some I < hg and show that it is also true for n = I + 1. 
We set 

v n := F{x* n ) - F(x n ) - T(x 5 n - x n ), 
w n := F(x 5 n ) - F{x n ) -y s + y. 

It then follows from the definition of {x s n } and {x n } that 

x n+l ~ x n+l = % n — x n — g a „(A n )F (x n ) (F(x n ) — y ) 
+ g an (An)F'{x n y(F{x n )-y) 
= r a M(xt - x n ) - g a JA)F'(x^* (v n - y 5 + y) 

- [g a MF'( Xn y - g an (A)F'( x *y] Wn 

~ [g an (A S n )F'(x 5 n y - g an (A n )F'(x n y] (F(x 5 n ) - y s ) . 

By telescoping the above equation and noting that Xq = xo we obtain 

l i 

4+i-^+i=E II r ak (A)g aj (A)F'(x^y (y 6 - y - Vj ) 

3=0 k=j+l 

-E IT r a M)[9aMi)^lr-9aMj)^ir]( F (^)-y s ) 

3=0 k=j+l 
I I 

( 5 - 26 ) -Ell r ak {A)[g a M3)F\x y - g^F'ix^w,. 

j=0 k=j+l 

In view of Assumption 1, Lemma 3.1 and Lemma 3.2 it follows that 




1 1 

(5.27) + C£ -( Sl - s^O-^olle.-IHI^II. 

3=0 ^ 
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By multiplying (5.26) by T and using (4.3) we obtain with B = F' (x^)F' (x*) that 

T(xf +1 - x l+1 ) - y s + y 

i i i 

= l[r aj (B)(y- y s )-J2 II r ak (B)g aj (B)B Vj 

3=0 j=0 fc=j+l 

j=0 fc=j+l 

J i 

-E T II r ak (A)[g a] (A 3 )F'(x 3 r - g aj (A)F'^r] Wj . 

3=0 k=j+l 

It follows from Assumption 1, Lemma 3.1 and Lemma 3.2 that 
\\T(xf +1 -x l+1 )-y 5 + y\\ 

1 1 _ ' 1 

< s + cJ2— ( s i - s j-i) _1 INI + C J2— ( s i - s i-i)~ lK 4 e j\\\\ w j\\ 

CX n CX j 

1 1 

(5.28) + — (*, - s.-ir^oH - ^llll^j) - y S l 

3=0 a 3 

With the help of Assumption 3, Lemma 5.1, Lemma 5.2 and the induction hypothe- 
ses we have 

INI < K (IN) + \\e s 3 \\) ||T(s* Xj )\\ < K \\eo\\8 

and 

IKII<* + I|r(^-^)II + IKII^*- 

Moreover, by using Assumption 3, Lemma 5.1 and (5.2) we have for < j < I 
\\F(xf) y s \\ < 5 + \\Tef\l + Ko^W ||Te*|| < 5 + sj 1/2 \\e \\ < sj 1/2 \\e \\. 

Combining the above three inequalities with (5.27) and (5.28) and using the induc- 
tion hypothesis \\Xj — Xj\\ < s X J 2 5 for < j < I it follows that 

' 1 

(5.29) ||a:? +1 - x l+1 \\ < (b 2 + CK \\e \\)5j2 — (*J - Sj-i)' 1 ' 2 

3=0 Uj 

and 

(5.30) \\T(xf +1 - x l+1 ) -y s + y\\<5 + K \\e \\5J2—(*i ~ 

3=0 aj 

By Lemma 4.1 and the fact si < si + i we obtain for small if ||eo|| that 

\\xf +1 - x l+1 \\ < (b 2 c 2 + CK Q \\e Q \\)s 1 l /2 S<2b 2 c 2S ]l 2 1 S 

Moreover, with the help of (5.1) we can derive 

\\T(xf +1 - x l+1 ) -y s + y\\ < (1 + CK \\e \\)S. 

Thus ||T(xf +1 — £C|_|_i) || < 36 if -£To||eo|| is suitably small. We therefore complete the 
proof of (5.25). 
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Next we will prove (5.24). From the above proof we in fact obtain 
||T(a£ - x n ) - y s + y\\ < (1 + CK \\e \\)5, 0<n<n s . 
Therefore, it follows from Assumption 3, Lemma 5.1 and Lemma 5.2 that 
\\F(x s n )-F(x n )-y s +y\\ 

< \\F(x 6 n ) - F(x n ) - T(x s n - x n )\\ + \\T(x s n - x n ) - y 6 + y\\ 

< K (\\e 5 J + ||e„||)||T(x* - x n )\\ + (1 + CK \\e \\)S 

< (l + CK \\e \\)5. 

The proof is thus complete. □ 

5.3. Completion of the proof of Theorem 2.2. We have shown in Lemma 5.1 
that ns < ns- Thus we may use the definition of ns and Proposition 5.1 to obtain 

(5.31) \\F(x ns ) y\\ < ||F«) - y s \\ + \\F(x s n{ ) - F(x ns ) - y s + y\\ < 5 

and for < n < ns 

t5 < \\F(x 5 n ) - y s \\ < \\F(x s n ) - F(x n ) y 5 + y\\ + \\F(x n ) - y\\ 
< (l + CK Q \\e Q \\)S+\\F(x n )-y\\. 

Since r > 1, if X ||eo|| is suitably small then 

(5-32) 5 < \\F(x n )-y\\ < \\Te n \\, Q<n<n s . 

We now prove the convergence of x 5 ns to as 5 — > 0. Assume first that there 
is a sequence 8k \ such that := ns k — > n as k — > oo for some finite integer 
n. Without loss of generality, we can assume that n^ = n for all k. It then follows 
from (5.31) that F{x n ) = y. Thus, from (5.7) we can conclude that Xj = x n for 
all j > n. Since Theorem 5.5 implies xj — > x> as j — > oo, we must have 
which together with Proposition 5.1 implies x s ^ k — > x^ as k — > oo. 

Assume next that there is a sequence 5k \ such that n^ '■— ns k — > oo as 

1/2 

fc — > oo. Then Theorem 5.5 and (5.32) imply that ||e„J| — > and s n ' fe 5fe — > as 
— >• oo. Consequently, by Proposition 5.1 we again obtain — > as fc — > oo. 



6. Numerical results 

In this section we present some numerical results to test the theoretical conclu- 
sions given in Theorems 2.1 and 2.2. We consider the estimation of the coefficient 
c in the two-point boundary value problem 



(6.1) 



-u" + cu = f in (0, 1) 
ti(0) = go, w(l) = .gi 



from the L 2 measurement u s of the state variable u, where go, gi and / G L 2 [0, 1] are 
given. This inverse problem reduces to solving (1.1) with the nonlinear operator F : 
D(F) C i 2 [0,l] i y L 2 [0,1] defined as the parameter-to-solution mapping F(c) := 
u(c), where u(c) denotes the unique solution of (6.1). It is well known that F is 
well-defined on 

D(F) := {c e L 2 [0, 1] : ||c- c\\ L 2 < 7 for some c > a.e.} 
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with some 7 > 0. Moreover, F is Frechet differentiable, the Frechet derivative and 
its adjoint are given by 

F'{c)h = -A{c)- 1 {hu{c)), 

F'(c)*w = -u(c).4(c)- V 

where A(c) : H 2 n Hq h->- L 2 is defined by A(c)u = —u" + cu. It has been shown in 
[5] that if, for the sought solution c\ |u(c*)| > k > on [0,1], then Assumption 3 
is satisfied in a neighborhood of c 1 *. 

In the following we report some numerical results on the method given by (1.5) 
and (1.6) with g a defined by (2.14), which, in the current context, defines the 
iterative solutions {c 5 n } by 

u n ,o = c s n , 

«n,i+i - u n j - F'(c s n y (F(c s n ) - u s - F'(c s n )(c s n - u n j)) , < I < [l/a n ] - 1, 

c n+l = u n,[l/a n ]- 

and determines the stopping index rig by 

(6.2) \\F(c s n5 )-u s \\ <tS< \\F(c s n )-u s l 0<n<n s . 

During the computation, all differential equations are solved approximately by finite 
difference method by dividing the interval [0, 1] into m + 1 subintervals with equal 
length h = l/(m + 1); we take m — 100 in our actual computation. 

Example 1. We estimate c in (6.1) by assuming /(i) = (l+t)(l + i — 0.8sin(27rf)), 
go = 1 and g\ = 2. If u(c)) = 1 + 1, then = 1 + 1 — 0.8sin(27rf) is the sought 
solution. When applying the above method, we take a n — 2~ n and use random 
noise data u 5 satisfying \\u 5 — w(c^)|| i 2r 01 i = 8 with noise level 8 > 0. As an initial 
guess we choose Co = 1 + t. One can show that Co — e H(F'(c')*). Thus, 
according to Theorem 2.1, the expected rate of convergence should be 0(8 1 ' 2 ). 



Table 1. Numerical results for Example 1 with a n — 2~ n and three distinct values 
of r, where ns is determined by (6.2), error := ||c* — c^||i2, and 
ratio := error/8 1 ^ 2 



8 


r = 1.1 


t = 2.0 


t = 4.0 


ks 


error 


ratio 


ks 


error 


ratio 


ks 


error 


ratio 


10" 


■2 


12 


4.67e- 2 


0.47 


9 


2.90e- 1 


2.90 


1 


5.65e - 1 


5.65 


10- 


3 


14 


1.47e-2 


0.47 


12 


3.89e- 2 


1.23 


12 


3.89e- 2 


1.23 


10" 


4 


16 


4.30e-3 


0.43 


15 


5.30e-3 


0.53 


14 


8.70e-3 


0.87 


10" 


5 


18 


1.30e-3 


0.40 


17 


1.80e-3 


0.56 


16 


2.80e-3 


0.87 


10" 


6 


21 


4.45e-4 


0.44 


19 


6.41e-4 


0.64 


18 


1.00e-3 


1.03 



The numerical result is reported in Table 1. In order to sec the effect of r in 
the discrepancy principle (6.2), we consider the three distinct values r = 1.1, 2 and 
4. In order to indicate the dependence of the convergence rates on the noise level, 
different values of 8 are selected. The rates in Table 1 coincide with Theorem 2.1 
very well. Table 1 indicates also that the absolute error increases with respect to 
t. Thus, in numerical computation, one should use smaller r if possible. 

In order to visualize the computed solutions, we plot in Figure 1 the results 
obtained for r = 1.1 and various values of the noise level 8, where the solid, dashed, 
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and dash-dotted curves denote the exact solution c\ the initial guess cq, and the 
computed solution c 5 ns respectively. It clearly indicates the fast convergence as 
S — >• as reported in Table 1. 



5=0.01 and n =12 

O 







■ -vS 




// 











8=0.001 and n =14 

O 



0.5 



1 




8=0.0001 and n g =16 



S=1e-005 and n g =18 




1 




Figure 1. Comparison on the computed and exact solution for 
Example 1 with t = 1.1 



Example 2. We repeat Example 1 but with r = 1.1 and the initial guess cq = 2 — t. 
Now Co — ^ TZ(F' (c 1 )*), and in fact Co — has no source- wise representation 
c - c) e K((F' '(c+)* F' V))") with a good v > 0. However, Theorem 2.2 asserts 
that ||c* — c' l '||i2[o ! i] — > as S — > 0. Figure 2 clearly indicates such convergence 
although the convergence speed could be quite slow which is typical for inverse 
problems. 
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